Papers by Goncalo Emanuel Cavaco Gomes
Evaluation of Multilingual Image Captioning: How far can we get with CLIP models? (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing approaches to evaluate image captions are English-centric, despite improvements in the CLIPScore metric . however, there are no available benchmarks for multilingual captioning evaluation . |
| Approach: | They propose to use machine-translated and machine-repurposed datasets to evaluate CLIPScore variants in multilingual settings. |
| Outcome: | The proposed evaluation strategies are based on machine-translated and human judgements. |
A Conformal Risk Control Framework for Granular Word Assessment and Uncertainty Calibration of CLIPScore Quality Estimates (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing caption evaluation metrics lack granular assessments for errors within captions . lack of uncertainty quantification can give way to misleading scores, reducing user trust . |
| Approach: | They propose a conformal risk control framework to generate and calibrate CLIPScore distributions . they use a model-agnostic conformal framework to detect erroneous words . |
| Outcome: | The proposed method detects erroneous words while providing formal guarantees aligned with desired risk levels. |